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ABSTRACT 



In the comparison of military units or systems, many attributes, 
including performance, might be measured. One general approach to de- 
termining which system is best involves forming a composite measure of 
the differentially weighted component measures. It is a fairly common 
practice to control the component means and variances; it is less com- 
mon, and more difficult, to control component covariances and, thus, to 
control the contribution of a component to the variance of the composite 
measure (variable). This paper presents a method leading to a computer 
procedure for assigning equal or differential influences on the composite 
by the use of component means, standard deviations, and covariances. 

Two numerical examples are given herein, one illustrating equal and the 
other unequal weighting. The technique appears to be both fast and pre- 
cise. 
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I. INTRODUCTION 



The section following this shows that the amount of variance 
a component contributes to a set of composite scores is a function of 
the component's variance and its covariances with the other components. 

If a component's original covariances are low, it may be an indication 
that this variable is measuring attributes different from those being 
measured by the remaining component variables, or that it is measuring 
the same attributes less reliably. By using the procedure and assumption 
described in this paper, a researcher can equalize the contributions 
of all of the components to the variance of the set of composite scores. 
Before doing so, however, he should have evidence available which 
leads him to conclude that it is necessary to increase the contribution 
of a variable having low covariance terms. If, for example, the com- 
ponent having low covariances consists of a set of judgments made by 
any individual rater, the researcher should be convinced that this rater 
was judging relevant attributes of behavior ignored by other raters, 
or that he is not, instead, contributing non-valid variance to the com- 
posite scores. If the latter is true, increasing the effect of these 
data by using the method presented in this paper is, at best, unfor- 
tunate. 



TT This report is an extension of an earlier article by R. S. Elster 
and C. 0. Nystrom, titled, "A computerized Method for Controll ing 
Components' Contributions to the Variance of a Composite", appearing in 
Educational, and Psychological UcasuAmcnt, Vol . 30, No. 3, Autumn 1970. 
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II. DERIVATION AND COMPUTATIONAL SOLUTION 

Beginning with an initial data matrix, the necessary equa- 
tions can be developed. In general terms, we usually have an n x k 
score matrix B, giving the scores of n units (or some other objects 
of evaluation) on k variables (components). This matrix is then 
standardized so that each component's observations have a mean of zero 
and a variance of one; this is designated as matrix Z. Matrix Z is 
also n x k. 

Before applying weights to any of the k component scores 
in Z, a composite score, C. , may be computed for each of the n 
evaluated objects by using: 



k 



k 




( 1 ) 



The variance of the array of C. 's is given by: 




• • • • 
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(k-1). For standard scores having a mean of zero and a variance of 
one, the variance of the array of C. 's is given by: 

S c = 1 + r 12 + •••• + r lk * 

1 + r 21 + + r 2k + l 3 > 



' + r kl + + r k(k-l) 

In equation (3) is a series of terms for each component consisting of 
the component's variance along with its correlations with all of the 
other components. As can be seen from equation (3), the contribution 
of the jth component to the composite score variance is given by: 

k 

Var (C.) = 1+1 r (4) 

J m=l jm 

m^j 

In order to accomplish the goal of controlling the proportion 
of the composite's variance contributed by each of the components, 
one obviously must be able to adjust the magnitudes of their variances. 
The adjustment method to be used here is similar to that used by 
Dunnette and Hoggatt (1957, pp. 430-434): we shall multiply the set 

of component scores by a set of weights; the weights will have values 
so that the magnitudes of their new variances will equal the propor- 
tions of variance we wish the separate components to contribute to 
the composite. 
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Designating the weight for the jth component by A., the 
new composite may be computed by: 



: i = ^ A J Z ij’ e ‘ 9 -’ C 1 = jl-, A j Z lj 



(5) 



If the components are in standard score form, the variance of 

l 

the C. 's is given by: 



i k k 

Var (C. ) = I A. 2 + I 

1 J=1 J j-1 



m=l 



A. A r. m 
J m j 



( 6 ) 



m^j 

and the contribution, b., of the jth component to the composite 

J 

score variance is given by: 



b. = A. 2 + T A. A 
J J m=T ^ 



r . 
m jm 



m^j 

An equation such as (7) can be written for each of the 
ponents. Given this set of j equations, and given that b. 

J 

nates the variance we wish component j to contribute to the 
the following system of quadratic equations must be solved. 



(7) 

j com- 
desig- 
composite. 



A. + l A. A r. 

J m £l J m jm 

m^j 



b. 

J 



( 8 ) 



j 1 ) 2 , ..., 



k 
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The solution to the above set of equations will yield the set of 
weights (the A.'s) to be used as multipliers with the k components 

J 

so that the desired values of the b.'s are obtained. 

J 

The procedure used for solving the system of simultaneous 
quadratic equations shown in equation (8) is the Newton-Raphson 
method as shown by Scarborough (1962, pp. 213-217). 

The computational procedure has been programmed as a sub- 
routine. To use it, the practitioner need only supply: 1) the 

original score matrix, giving the scores of n persons on the j 
components; 2) the proportion, b- , that each of the j components 

J 

is to contribute to the variance of the composite (each b. must be 

J 

expressed as a positive decimal, and the sum of the b 's must be equal 
to one); and 3) an e value that terminates the iterative compu- 
tational procedure. The parameter e will be discussed later in this 
report. 



III. MATHEMATICS OF THE COMPUTATIONAL PROCEDURE 

In the case of two components, there would be two equations 
in two unknowns. Let <t>(X,Y) = 0, and ^(X,Y) = 0 represent the two 
equations. If X Q , Y q are approximate roots of <J> and \p , and 
h and l are corrections, then let 



X = X o + h 
o 
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Y = Y o + 1 

Scarborough (1962, pp. 214) shows that 

4>(X 0 ,Y 0 ) + h(64>/6x) 0 + A(d*/6y) 0 = 0 

4»(X 0 » Y 0 ) + h(.&l»/$x) 0 + £(6ip/6y ) Q = 0 



1 

(6<p/ 6x) Q 


(6<b/6y) o 


h 


1 


- *<vv 


(Sip/ 6x) q 


(6i/j/6y) o 


l 


= 


- *<w 



(9) 



The goal is to solve for h and l letting X-| = X Q + h, = Y Q + £, 
etc.; iterating until a desired level of accuracy is achieved. 

In the general case of weighting components which are In standard 
score form (using the notation from equation (8)): 



<t>. = A. y A r. - b. ; j = 1 
J J ra =l m jm j 



= 1, 2, ..., K 



(10) 



it if 

Then, letting <b. = 4> ./A . , and differentiating, A 

J J J J III 

★ 2 

when j + m and S<f>./SA = h-/A. + 1 , when j = m. 

J l*J J J 

So for the general case, Equation (9) becomes 
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The iterations are performed by letting + h., 

J J J 

j = 1, 2, k, and recalculating both the right-hand array and 

the diagonal of the coefficient array. For an exact solution, the 
right-hand side of Equation (11) will go term by term to zero. The 
convergence procedure used by the author of this paper tested to 
determine if the terms on the right side of Equation (11) had all 
become equal to, or less than, an epsilon (e). The user must specify 
an e value which is used in terminating the iterations when all of 
the terms on the right-hand side of Equation (11) are <e . Initially, 



A ( . o) = 1.0 for all j . 
J 
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IV. EXAMPLES 

Artificial raw scores were generated yielding the standard 
score covariance matrix given in Table 1. (This matrix is an optional 
output available from the computer program allowing the user to 
examine the original component weights.) 

By examining the row of figures in Table 1 giving the percent 
contribution of each rater (component) to the variance of the composite 
scores, it is evident that the original components are unequally 
weighted. Using the data given in the table, two solutions are 
demonstrated in the following paragraphs. The first example illus- 
trates the case in which the user wishes to assign equal weights to 
all of the components. In the second example, the user assigns 
unequal proportions to the components. 

Table 1 STANDARD SCORE COVARIANCE MATRIX 
Raters Raters (Components) 



(Components) 


A 


B 


C 


D 


E 


F 


A 


1 .00 


-.225 


.233 


-.084 


.118 


-.509 


B 


-.225 


1 .00 


-.009 


.521 


.099 


-.151 


C 


.233 


-.009 


1.00 


.112 


.256 


-.306 


D 


-.084 


.521 


.112 


1.00 


.196 


-.264 


E 


.118 


.099 


.256 


.196 


1.00 


-.236 


F 


-.509 


-.151 


-.306 


-.264 


-.236 


1.00 


Rater's Contribution 
to the composite score 
variance .533 1.235 


1.286 


1.481 


1.433 


-.466 



Total score variance = 5.502 
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A. Equal Weighting 

The data summarized in Table 1 were initially run through 
the computational subroutine with the specification that each of the 
six components should make an identical contribution to the variance 
of the composite. The weights to be applied to the components' 
standard scores in order to equate the contributions of the six 
components are given in Table 2. The weights in Table 2 were derived 
by applying the computational method outlined above to the system 
of six equations similar to that given in Equation (8); the weights 
in Table 2 are the roots of the six equations for this example. 

Table 2 WEIGHTS TO BE USED AS MULTIPLIERS WITH 
THE COMPONENTS' STANDARD SCORES FOR THE EQUAL CONTRIBUTION EXAMPLE 

Raters (Components) A B C D E F 

Weights 1.638 1.031 .937 .904 .858 2.144 

Table 3 shows the covariance matrix that resulted after 
applying these weights to the components' standard scores. Table 3 
(using the notation of Equation 8) contains the elements A. 2 r.. 

vJ 0 vJ 

on the main diagonal and the elements A^ A^ rj m off the diagonal. 

The column in Table 3 that lists the percentage of the 
composite's variance contributed by each of the components shows that 
the contributions of the six components were equated by the computa- 
tional method. The solution of the equations required 4 iterations; 
about 3.2 seconds of computer time was required for the entire run. 



10 



(The iterations were terminated when each of the six roots had an 
accuracy of £.00001.) 

B. Unequal Weighting 

To illustrate that the computatonal procedure can also be 
used in solving for differential weights, Tables 4 and 5 show the 
results obtained when the six components were specified as contributing 
.50, .10, .10, .10, and .10 of the composite's variance. This run 
required 4 iterations to achieve £.00001 accuracy for each of the 
six roots. 

Table 3 COVARIANCE MATRIX DERIVED AFTER APPLYING THE COMPUTED 
WEIGHTS FOR THE EQUAL CONTRIBUTION EXAMPLE 



Raters 

(Components) 


A 


Raters (Components) 
BCD 


E 


F 


Per . 
Cent 3 


A 


2.683 


-.380 


.357 


-.125 


.166 


-1.788 


16.67 


B 


-.380 


1 .063 


-.008 


.485 


.087 


-.334 


16.67 


C 


.357 


-.008 


.878 


.095 


.206 


-.615 


16.67 


D 


-.125 


.485 


.095 


.817 


.152 


-.512 


16.65 


E 


.166 


.087 


.206 


.152 


.736 


-.433 


16.68 


F 


-1.788 


-.334 


-.615 


-.512 


-.433 


4.595 


16.67 


Rater's Contribution 
to the composite score 
variance .913 .913 


.913 


.912 


.914 


.913 


100.01 



Total score variance = 5.478 



a Percent the component contributed to the composite's variance 
^This column does not total to 100.00 due to rounding errors. 
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Table 4 WEIGHTS TO BE USED AS MULTIPLIERS WITH THE COMPONENTS' 
STANDARD SCORES FOR THE UNEQUAL CONTRIBUTION EXAMPLE 

Raters (Components A B C D E F 

Weights 2.324 .960 .680 .772 .654 2.151 



Table 5 COVARIANCE MATRIX DERIVED AFTER APPLYING THE COMPUTED 
WEIGHTS FOR THE UNEQUAL CONTRIBUTION EXAMPLE 



Raters 




Raters (Components) 


Per . 


(Components) A 


B 


C 


D 


E F 


Cent 3 


A 5.402 - 


.503 


.368 


-.151 


.180 -2.546 


49.99 


B -.503 


.922 


-.005 


.386 


.062 -.312 


9.98 


C .368 - 


.006 


.463 


.059 


.114 -.448 


10.00 


D -.151 


.386 


.059 


.596 


.099 -.438 


10.02 


E .180 


.062 


.113 


.099 


.427 -.331 


10.02 


F -2.546 - 


.312 


-.448 


-.438 


-.331 4.625 


10.00 


Rater's Contribution 










100.01 


to the composite score 
variance 2.750 


.549 


.550 


.551 


.551 .550 




Total 


score variance : 


= 5.501 




a Per cent the component contributed 


to the 


composite's variance 


b This column does not 


total 


to 100. 


00 due 


to rounding errors. 
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V. SUMMARY 

A computer procedure was developed for weighting components in 
a composite. The procedure allows the user to freely choose how much 
of the variance of a set of composite scores is contributed by each 
of a number of components. 

Two numerical examples using artificial input data were 
demonstrated illustrating an equal weighting solution and an unequal 
weighting solution. In both sample problems, the solutions reached the 
desired level of accuracy in about three seconds. 
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